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Abstract. In recent years, important progress has been made in applying methods and techniques 
£f~)~ • of convex optimization to many fields of applications such as location science, engineering, com- 

putational statistics, and computer science. In this paper, we present some simple algorithms for 
solving a number of new models of facility location involving sets which generalize the classical 
Fermat-Torricclli problem and the smallest enclosing circle problem. The general nondifferentia- 
bility of the models prevents us from applying gradient-type algorithms, so our approach is to use 
subgradient-type algorithms instead. The algorithms presented in this paper are easy to implement 
and applicable for a broad range of problems that are also suitable for teaching and learning convex 
optimization. 
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1 Problem Formulation 

> 

In the early of the 17th century, the French mathematician Fermat introduced an optimiza- 
tion problem which asks for a point that minimizes the sum of the distances to three given 



points in the plane. This problem was solved by the Italian mathematician and physicist 

cn 
O 
m 



Torricelli. The problem is now called the Fermat-Torricelli problem, and it is one of the 
main problems that led to new developments of location science. A new model of facility 



location where the given points are replaced by a finite number of sets (not necessarily con- 
vex) has been introduced recently in [16]. Since then, many other set location models have 
been introduced and studied; see [14, 15, 20, 21] and the references therein. In particular, 
general models of facility location that involves both shortest distance and farthest distance 
functions to sets were introduced in [21]. These models generalize the Fermat-Torricelli 
problem and the Sylvester smallest enclosing ball problem which asks for the smallest circle 
that encloses a finite number of points in the plane. 

In this paper, we focus only on the numerical aspect of the optimization models introduced 
in [21] specified to the finite dimensional case. In M n with the Euclidean norm || ■ ||, given 
a convex set F (not necessarily bounded) that contains the origin as an interior point, and 
given a target set ft, the minimal time function defined by the dynamic F and the target 
set O is given by 

T F (x; Q) := M{t > | (x + tF) n / 0}. (1.1) 
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Similarly, for a bounded set 0, the corresponding maximal time function is defined by 

C F {x; 0) := wf{t > | 9 C (x + tF)}. (1.2) 

These functions are generalizations of the shortest distance function and the farthest dis- 
tance function. In fact, when F is the closed unit Euclidean ball of K n , the minimal time 
function (1.1) reduces to the shortest distance function/ distance function 

d(x;n) :=mf{\\x-w\\\w en}, (1.3) 

and the maximal time function (1.2) reduces to the farthest distance function 

M(x; ft) := sup{||x — w\\ \ w E 0}. (1.4) 

Consider a finite collection of nonempty closed convex sets J7j for i G / and another finite 
collection of nonempty closed bounded sets Qj for j G J (not necessarily convex) , the gener- 
alized Fermat-Torricelli introduced in [21] can be formulated as the following optimization 
problem: 

minimize T(x), x G Q, (1-5) 
where Q is a convex constraint set, and the cost function T is defined by 

T(x) := T F (x; SU) + ]T C F (x; Qj). 
iei jeJ 

If F is closed unit Euclidean norm of W 1 , problem (1.5) reduces to a simpler version as 
below: 

minimize V{x) : = ^ d(x; Qj) + ^ M(x; Qj), x G Q. (1.6) 
iei j&J 

In the case where all of the sets f2j for i € / and Qj for j £ J reduce to singletons, and 
the constraint set Q is the Euclidean plane, the generalized Fermat-Torricelli problem (1.6) 
reduces to the Fermat-Torricelli problem for a finite number of points. 

Another model of our interest is the generalized Sylvester problem: 

minimize S(x) := max{Qi(x),Q2(x)} subject to x G Q, (1-7) 
where Q\{x) := maxjgj Tp{x; Oj) and Giix) '■= maxjej Cf(x; Qj)- 

Using different dynamics, we are able to obtain different versions of problem (1.5) and 
problem (1.7) involving distance functions generated by different norms of W 1 and mini- 
mal/maximal time functions generated by different Minkowski gauges. It is also possible 
to use different dynamics Fi for i G I and Ej for j G J, but we will not consider this for 
simplicity. 

It is well-known that the Weiszfeld algorithm [12, 31] and its modifications provide effective 
tools for solving the classical Fermat-Torricelli involving a finite number of points. However, 
in the general case of problem (1.5) and problem (1.7), because of the nonsmoothness, 
there are not a lot of options for numerical algorithms for solving the problems other than 
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subgradient-type algorithms. In fact, subgradient-type algorithms allow us to solve the 
problems in a very broad setting that involves distance functions generated by different 
norms and minimal time/maximal time functions generated by different Minkowski gauges; 
see .e.g. [20]. The classical subgradient method is known to be slow in general. Thus, it is 
not a good option when the number of target gets O, for i € I and Qj for j G J are large. 
An new method called incremental subgradient method was developed in order to improve 
the performance of the subgradient method when the cost function is represented as a sum 
of a finite number of convex functions. A question is: can we develop a simpler algorithm 
that can be used for solving problem (1.5) and improving both afore-mentioned subgradient 
algorithms when the number of target sets is large? The stochastic subgradient method is an 
answer for this question. It has been shown by [27] that the stochastic subgradient method 
is an effective tool for solving large-scale Support Vector Machines (SVMs). This simple 
method also shows its effectiveness in solving the generalized Fermat-Torricelli problem 
(1.5). 

In this paper, we first present the tools of convex analysis for minimal time and maximal 
time functions recently developed by the first author and his coauthors. Then we present 
simple implementation of three subgradient methods to problem (1.5) and problem (1.7) in 
the general forms as well as their specifications. The readers are referred to our recent paper 
[21] for theoretical studies of these problems. We also introduce and study new models of 
facility location called directional location problems. 

Throughout the paper, we make the following standing assumptions and notations: F is 
a nonempty closed convex set that contains the origin as an interior point; fij for i £ I 
are nonempty closed convex sets; Qj for j £ J are nonempty closed bounded sets that are 
not singletons; \\ ■ \\ is the Euclidean norm ofW 1 ; IB is the closed unit Euclidean ball of 
W 1 ; IB(a;r) is the closed Euclidean ball with center a and radius r; R + is the set of all 
nonnegative real numbers. 

2 Tools of Convex Analysis 

In this section, we present some basic concepts and results of convex analysis. A systematic 
development of convex analysis can be found, for instance, in [17, 25]. Let / : W 1 ->lbea 
convex function. For x € M. n , a subgradient of / at x is a vector v € W 1 that satisfies 

(v, x - x) < f(x) - f(x) for all x <E R n . 

The set of all subgradients of / at x is called the subdifferential of / at this point and is 
denoted by df(x). It is well-known that for a convex function / : lR n — >• R, the subdifferential 
of the function at any point is a nonempty compact subset of M n . 

Subgradients of the minimal time function (1.1) and the maximal time function (1.2) ob- 
viously play a crucial role on developing subgradient-type algorithms for solving problems 
(1.5) and (1.7). In what follows, we present subdifferential formulas for these functions. It 
turns out that subgradients of the minimal time function (1.1) depends, first of all, on the 
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asymptotic cone of the dynamic F: 

Foo := {d £K n | x + td G F for all * > and for all x G F}. 
In our consideration, G F, and F^ has the following simple representation: 

Foo = C\t>otF. 

It is not hard to see that F^ is a closed convex cone, and it reduces to {0} if and only if F 
is bounded. 

Subgradients of the minimal time function (1.5) also depend on the following set 

F* := {w G R n | (w, -x) < 1 for all x G F}. 

Thus, if we define cr F (w) := sup xeF {w, x), then 

F* := {w G R n | a(-w) < 1}. 

From the definitions, it is clear that when F is the closed unit Euclidean ball of M n , one 
has that cr F {w) = IMI an d F* = IB. 

For a convex set f2, the normal cone to f2 at x G Vt is defined by 

N(x; n) := {w G R n | (w, x - x) < for all x G 0}. 

Let us first start with a subdifferential formula for the minimal time function (1.1). For 
x ^ f] — Fqo (this set reduces to £1 when F is bounded), the projection from x to f2 associated 
with the minimal time function (1.1) is 

II_p(x; fi) := {w G | Tp(x; CI) = pf(w — x)}. 

Theorem 2.1 Let Cl be a nonempty closed convex set. 
(i) Suppose that F is bounded. Then 



dT F (x;Cl) 



N(x;Q)nF* ifxen, 
[-dp F (w-x)]DN(w,n) ifx^Q, 



for any w G H F (x; CI). 

(ii) Suppose further that fl is bounded. Then 



dT F (x;Cl) 



N(x; Cl — Fqo) n F* ifxeCl, 
[-dp F {w - x)] n N(w; Cl) ifx&Tl-Fov, 



for any w G H F (x\ CI). 



As a corollary, we obtain the next well-known formula for subdifferential of the distance 
function (1.3). 
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Corollary 2.2 For a nonempty closed convex set CI, the following representation holds: 



dd(x; CI) 



N(x;Cl)nB ifxeCl, 
< d(x ; ») } 



where H(x; CI) is i/ie Euclidean projection from x to Cl, which is a singleton, given by 

U(x; 0) := {w G n | d(x; Cl) = \\x - w\\}. (2.8) 

As mentioned earlier, the maximal time function (1.2) is always convex. It subdifferential 
formula follows from a well-known formula for subdifferential of "max" function in convex 
analysis. For any x € W 1 , the farthest projection from x to 9 associated with the maximal 
time (1.1) is defined by 

P F (x; 9) := {w € G | C F (x; 9) = p F {w - x)}. 

In the case where F = IB, this set becomes the Euclidean farthest projection from x to Q: 

P(x; 6) := {w G 9 | M(x; 9) = ||x - w||>. 

Theorem 2.3 Suppose that 9 is a compact set. Then S(x) := H F (x; 9) is a compact set 
and 

dC F {x; 9) = co U we5(i) [-dp F (w - x)]. 

As a corollary, we obtain a simple formula for subdifferential for the farthest distance 
function (1.4). 

Corollary 2.4 Suppose that 9 is a compact set that is not a singleton. Then S(x) := 
P(x; 9) is a compact set and 

x — co S(x~) 



dM{x;Q) 



M(x;6) ' 



The minimal time function (1.1) and the maximal time function (1.2) can be represented 
in terms of the Minkowski/gauge function associated with F, which is defined by 

p F (x) := inf{* > | x e tF}. (2.9) 

In fact, one has the following representations: 

T F (x; CI) = inf p F (w — x), 

C F (x; 9) = sup p F (w — x). 

The first formula was proved in [19], while the second formula can be derived from a similar 
formula dealing with the case where F is bounded; see [14]. From these formula, it is also 
not hard to show that both functions (1.1) and (1.2) are globally Lipschitz. The minimal 
time function (1.1) is convex when Cl is convex, and the maximal time function (1.2) is 
always convex despite the nonconvex nature of the target set 9. 
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3 A Generalized Fermat-Torricelli Problem 



3.1 The Subgradient Algorithm 

The subgradient method was introduced in the 1960s by the work of Naum Z. Shor and 
others to deal with convex nonsmooth optimization problems. For a convex function 
/ : W n — > R, the subgradient method iteration (see [1,28]) for solving the constrained 
optimization problem 

minimize f(x), x G Q, (3.10) 

is given by 

x k +i := n(x fc - a k w k ; Q), V k+1 := min{Vfc, f(x k )}, 

where w k G df(x k ), a k G M + , x\ is chosen, and U(u;Q) denotes the Euclidean projection 
from u to the set Q given by (2.8) if u ^ Q, and II(it; Q) = {u} if u G Q. 

In the subgradient method, at iteration k, we only need to find one subgradient of the 
cost function at x k . Moreover, the constrained set Q must be simple enough to find the 
Euclidean projection. 

In the case where the optimal value of the function V is finite, we are interested in finding 
a suboptimal solution of the problem, that is a point x t G M n such that 

f(x e ) —V<€. 

Therefore, instead of investigating the convergence of (x k ) to an optimal solution, we care 
more about the convergence of (V k ) to the optimal value V. 

When applying to the generalized Fermat-Torricelli problem (1.5), at iteration k, we need 
to find a subgradient u k i of each component function (fi(x) = Tp(x;Oj) for i £ I, and a 
subgradient v k j of i/jj( x ) = Cf(x; Qj) for j G J. By the well-known subdifferential sum rule 
of convex analysis 

Wk ■= ^Uki + ^ v kj 
iel jeJ 

is a subgradient of T at x k . 

Theorems 2.1 and 2.3 as well as their specifications in Corollaries 2.2 and 2.4 provide us 
with a method of finding such a subgradient. Notice that if x k G f2j, the subdifferential 
dTp(x k ; Cli) always contains 0, so we can choose u k i = 0. In the case where x k £ Oj, a 
subgradient u k i can be found by using a projection point w k i of TlF(x k ; fij), and using sub- 
gradients of the Minkowski function. The readers are referred to [15] for different examples 
of computing subgradients of the minimal time function. In particular, if F is the closed 
unit Euclidean ball of M n , the formula for u k i is explicit: 

x k - w ki 

\\Xk ~ W ki \\ 

It is similar to determine v k i at iteration k. 

Let us now present a pseudocode for solving problem (1.5). For simplicity, we assume that 
F is bounded here and throughout the rest of the paper. 
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INPUT: K, F, fi, for iel, Q 3 for j G J, 


and a 


sequence 


of step 


sizes (afc) 








INITIALIZE: Choose a starting point X\ 


and compute V\ 


= T(n) 


FOR k = l,...,K 








if x k Qj 








Choose pki 6 IIi?(a;fe; Qj) and find lifci G - 


dpF(Pki 


-x k )nN(p 


feii ^i) 


for t g / 








else 








set Ufci := for i E I 








end if 








Choose gfej G Pp{xk',Qj) and find Ufej G - 


dp F {qk 3 


- Xk) for 


i e J 


Set w fe := 2 iG j «fc t + Ej G j «Aj 








Set Xfc+i := n(x fc - a k w k ;Q) 








Compute V k +i := min{V k ,T(x k+ i)} 








OUTPUT: V K +i and x k such that T(x k ) = Vk+i 







As a special case, let us present a pseudocode for solving problem (1.6). 



INPUT: K, Qi for i£l, Qj for j G J, and a sequence of step 
sizes (afc) 

INITIALIZE: Choose a starting point X\ and compute Vi=T>(x\) 
FOR fc = 1, . . . ,K 
if x k (ji Qi 

set := — — for i G I 

d{x k ;ili) 

else 

set u k j := for i £ I 
end if 

Choose q k j € P(xk]@j) and set «fej : = 777 77T for j G J 

Set w k := Ukt + Ejej "fcj 
Set := U(x k - a k Wk] Q) 

Compute Vk+i :=rmn{Vk,T>(xk+i)} 
OUTPUT: Vk+i and x k such that V(x k ) = V K +i 



The readers are referred to [3] for different way of choosing the step sizes (afe). Let us 
present below the convergence result for two important cases. The proof is given in [1,3]. 

Theorem 3.1 Under the standing assumptions made, suppose that the solution set of prob- 
lem (1.5) is nonempty. If the sequence (a&) converges to and EfcLi a k = °°> then the 
sequence (14) in the algorithms presented in this section converges to the optimal value 
of the problem. Moreover, if we assume additionally that E/jbLi a \ < °°> then (x k ) also 
converges to an optimal solution of the problem. 



The subgradient algorithm exhibits slow convergence rates when applying to the generalized 
Fermat-Torricelli problem (1.5). One of the reasons is that in each iteration in order to get 
an improvement, we need to calculate all subgradients Uki for i E I and v k j for j E J, and it 
is computationally expensive if the number of target sets is large. In order to overcome this 
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shortcoming, the stochastic subgradient method and the incremental subgradient method 
provide other alternatives. 

3.2 The Stochastic Subgradient Algorithm 

For a convex function / : R n — >• R, we say that v is called a noisy (unbiased) subgradient of 
/ at x if the expected value E(y) G df(x). That means 

(E(v),x -x)< f(x) - f{x) for all x G R n 

The stochastic subgradient method for problem (3.10) can be formulated as follows: 

x k+1 := U(x k - a k w k ; Q), V k+1 := mm{V k , f(x k )}, 

where E(w k ) G df(x k ), a k G R + , x\ is chosen, and H(u; Q) denotes the Euclidean projection 
from u to the set Q given by (2.8) if u ^ Q, and IL(u; Q) = {u} if u G Q. 

Let us first present the simplest version of the stochastic subgradient method for problem 
(1.5). The main idea is that in each iteration, we do not have to scan through all the target 
sets in order to get a subgradient as in the subgradient method. We only need to choose 
uniformly at random one index t in the disjoint union of I and J, or find a subgradient 
w kt G dTp(x k ; fit) if t G I, and find a subgradient w kt G dCp(x k ; Qt) if t G J. After that, 
define 

w k := + | J\)w kt , 
and perform the iteration x k+ \ := Tl(x k — a k w k ; Q). 

A more general method can be presented as follows. Fix a positive integer p such that 
P ^| + \J\- At the iteration k, we choose uniformly at random a nonempty set of indices 
A k i \A k \ = p, that is a subset of the disjoint union of / and J. Set I k = A k Pi I and 
Jk = A k n J. Then for each i G I k , find u k i G dTp(x k ; fij), and for each j G J k , find 
■Ufcj G dCp(x k ; Qj). After that set 

^ :=(\I\ + \J\) E ^ hUkl + E ^ Vk \ 

P 

and perform the iteration := 11(3;^ — a k w k ; Q). 

A similar method has been successfully applied to solving SVMs; see [27]. Let us now 
present a pseudocode for solving problem (1.5) with the use of Theorems 2.1 and 2.3 as well 
as their specifications in Corollaries 2.2 and 2.4. 
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INPUT: p, K, F, Qi for i G I, Qj for j G J, and 


a sequence of step 


sizes (a k ) 




INITIALIZE: Choose a starting point X\ and compute Vy = 7~(xi) 


FOR k=l,...,K 




Choose l^lfcl =p, to be a nonempty subset 


of the disjoint 


union of I and J, uniformly at random, and 


set l k = A k r\ 1 


an ri Ti — Ai D T 




if Ti. ^ ft. 




Choosp r> TT J? ( xz~ ■ ) and. find F —Ooir(T)Ln — 


xi.) n Niwi-i - QA 


for i E Ik 




else 




set life, := for i G I k 




end if 




Choose qk 3 & PF(x k ;Qj) and find v kj G -dp F (q kj - 


Xk) for j G Jr- 


Set w fc :- (Eiei^ki + EjeJ^kj) 
Set Xfe+i := U(x k - a k w k ;Q) 






Compute Vfc+i := min{Vk,T(xk + i)} 




OUTPUT: Vjc+i and x fc such that T(xfe) = Vr-+i 





We can similarly write a pseudocode for solving problem (1.6). 



INPUT: p, K, Qi for i G /, Oj for jEJ, and a sequence of step 
sizes (afc) 

INITIALIZE: Choose a starting point X\ and compute V\ — T>{x\) 

FOR k=l,...,K 

Choose A k , \Ak\=p, to be a subset of the disjoint union of 
/ and J, uniformly at random, and set I k = A k D I and J k = A k H J 
if x k €" f2i 

set := for i G h 

d{x k ;ih) 

else 

set u k i := for i <E I k 
end if 

Choose qkj G P(x/ £ ;0 :) ) and set v kj := — — — — for j G J k 

M \X k ] ) 

Set w k := ^ + J (T, ie i k u ^ + E je j k v kj) 
Set x k+ i := U(x k - a k w k ;Q) 
Compute Vfc+i := mm{V k ,V(x k+1 )} 
OUTPUT: V K +i and x k such that V(x k ) = V K+1 



As an example, let us consider the stochastic subgradient method applied to the generalized 
Fermat-Torricelli problem for Euclidean balls. For a ball ft := iB(a;r), using Corollaries 
2.2 and 2.4, it is not hard to see that 

'N(x-,n)niB if x eft, 

• l \x — ay 
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and 

{IB if x = a, 

r x-a , ., . 
I TP 11/ 11 
\\x — a\\ 

Example 3.2 Let fij := JB(di\ri) for i £ I and 0, := JB(bj\Sj) for j € J, where r,; > 
for every i g I and s,- > for j £ J. We consider the stochastic subgradient method for 
solving problem (1.6). In each iteration, we choose one random index uniformly. 



INPUT: K, ai,n for iel, bj,Sj for jeJ, 


and a sequence of step 


sizes {oik) 




INITIALIZE: Choose a starting point X\ 


and compute V\ = T>(x\) 


FOR k=l,...,K 




Choose a random index t uniformly in the disjoint union of 


/ and J 




if t e / 




if x k n t 




x k - a t 

set Wkt ■= 7i m 

\\xk - a t || 




else 




set w kt ■= 




end if 




end if 




if t G J 




if x fc ^ fe t 




Xk — bt 

set Wfet := T . — 77 

\\Xk - b t \\ 




else 




set Wkt ■= 




end if 




end if 




Set w k := + \J\)wkt 




Set Xk+i := U(xk - akWk] Q) 




Compute Vfe+i := min{Vfc,2?(.T fe+ i)} 




OUTPUT: V K +i and x k such that V{x k ) = V K 


+i 



The readers are referred to [1] for more detail of the stochastic subgradient method. 
3.3 The Incremental Subgradient Algorithm 

Let us now present another improvement of the subgradient method. In [23], the authors 
developed an incremental subgradient method for solving the optimization (3.10), where / 
is represented as a sum of m convex functions fi for i = 1, . . . , m. Their idea is to construct 
Xk+i based on Xk as follows: 

Xk+l ■= i>m,k, 
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where ip m ,k is obtained after m steps: 

A,k '■= P(ipi-i,k ~ Oi k g i)k ; Q) 
9i,k e i = 1, . . . , m, 

starting with ipQ^ '■= x k - 

It has been experimentally observed in [23] that the incremental gradient method has a 
faster convergence rate compared with the subgradient method when m is large. Moreover, 
in the smooth case, the incremental gradient method often converges much faster than the 
steepest descent method when far from the eventual limit. Observe that the situation when 
/ is represented as a sum of m functions applies directly to our generalized Fermat-Torricelli 
problem (1.5). 

When applying to the generalized Fermat-Torricelli problem (1.5), the difference between 
the subgradient method and the incremental subgradient method is that at the iteration k, 
instead of scanning through all of the target sets and get an improvement of the cost func- 
tion, the incremental subgradient method also scan through all of the target sets. However, 
it keeps changing the sequence at each target set. This also explains the difference between 
the stochastic subgradient method and the incremental subgradient method. 

Let us now present a pseudocode for solving the generalized Fermat-Torricelli problem using 
the incremental subgradient method. For simplicity of notation, assume that I = {1, . . . , m} 
and J = {m + 1, . . . , m + £}. 



INPUT: K, F, fi, for iel, Qj for jeJ, and 


a seguence of step 


sizes {cx-k) 




INITIALIZE: Choose a starting point X\ and 


compute V\ — T(xi) 


FOR k = l,...,K 




Set w k ,o := x k 




for i = 1, . . . , m 




if w k ,i-i i 




Find p k ,i e ILF(wk,i-i;£li), find Uk,i £ 


-dp F (pk,i - Wk,i-i) n N(p k>i ; Oj), 


and set w k ,i :— H{w k ,i-i - a k Uk,i] Q) 




else 




Set w k ,i = IL{w k ,i-i;Q) 




end if 




for j = m + 1 , . . . , m + I 




Find qk,j e PF(wk,j-x;Qj), find v k j € -dp 


p(qk,j - Wk,j-i), 


and set w k ,j := U(wk,j-i - ctkVk,j] Q) 




Set Xk+i ■= w k: m+e 




Compute Vfe+i := mm{Vfe,T(x fc+ i)} 




OUTPUT: V K +i and x k such that T(x k ) =V K +i 
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4 A Generalized Sylvester Problem 



4.1 The Subgradient Algorithm 

Consider the function S given in (1.7). For u € W 1 , the active index set at u is defined by 

A x {u) := {ieI\S(u)=T F (u;ni)}, 
A 2 (u) := {j eJ\S(u) = C F (u ] e j )}, 
A(u) := Ai(u) UA 2 {u). 

where U is the disjoint union notation. 

Let us present a pseudo code for solving problem (1.7) based on the subgradient algorithm. 



INPUT: K, F, fli for i E I , @j for j G J, and a sequence of 
step sizes («&) 

INITIALIZE: Choose a starting point Xi and compute V\ — S(xi) 
FOR k = 1,...,K 

Find an index t € A(xk) 

if t e Ai(xk) 

if x k e fi t 

Find p t G Hp{xk; f2 t ) and find w k e -dp F (pt - x k ) f) N(w k ;tt t ) 

else 

Set w k = 
end if 
end if 

if t G A 2 (x k ) 

find q t G PF{x k ;£lt) and find lUfc G -dp F {qt - x k ) 
end if 

Set x k+ i := U(x k - a k w k \ Q) 
Compute Vfc+i :=mm{Vk,T(x k+ i)} 
OUTPUT: Vff+i and x fe such that T(x k ) = V K +i 

As a special case, let us present a pseudocode for solving problem (1.7), where F is the 
closed unit Euclidean ball of M n , based on the subgradient algorithm. 
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and. compute 


Vt = S(xi ) 


FOR = 1, . . . , K 
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ii t t -Til yu^k } 






if r t ^ ilf 






x k - H(xk] fit) 












else 






C ~H nil, | I 






end if 






end if 






if teA 2 {x k ) 






choose pt 6 P(xk',&t) and set 


' M(x k; e t ) 




end if 






Set a^+i := U(x k - a k w k ;Q) 






Compute Vk+i := min{Vfc,T(xfc+i)} 






OUTPUT: Vk+i and x k such that T{x k ) = 


- Vk+i 





5 Directional Location Problems 

5.1 Problems Formulations and Theoretical Analysis 

Let v be a nonzero vector and let SI be a nonempty closed set of a W 1 . The directional 
minimal time function associated with direction v and target set is defined by 

T v (x;n) = inf{i > | x + tv E fi}. (5.11) 

This function has recently been introduced and studied in [22]. Notice that the directional 
minimal time function (5.11) is a particular case of the minimal time function (1.1) when 
F = {v}. However, in this situation, the assumption that € hit F is never satisfied. 

Let us present some basic properties of the minimal time function (5.11). The detail and 
more properties of the function in infinite dimensions can be found in [22]. 

Proposition 5.1 Let Q be a nonempty closed set. The minimal time function (5.11) has 
the following properties: 

(i) T v (x; Q) = if and only if x € 0; 

(ii) dom T V (-;Q) = — cone {v}; 
(hi) T„(-;f2) is lower semicontinuous; 

(iv) T V (-;Q) is convex if and only if £1 is convex. 

The first model we study in this section is a generalization of the Fermat-Torricelli problem. 
Given a finite number of nonzero vectors V{ for i 6 I and a finite number of nonempty closed 
target sets Qi for i £ I along with a nonempty closed constraint set Q, the directional 
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generalized Fermat-Torricelli problem is 

minimize 71 (x) = JjT Vi (x; 0,j ) subject to x G Q. (5.12) 

Another problem under our consideration is the directional generalized Sylvester problem: 
minimize S±(x) := max T Vi (x;£li) subject to x G Q. (5.13) 

Let us start with some theoretical analysis of problem (5.13) and refer the reader to [22] for 
the analysis of problem (5.12). It is not hard to prove the proposition below following the 
proof in [22] . 

Proposition 5.2 Suppose Q n dom «Si ^ 0. Problem (5.13) admits an optimal solution if 
at least one of the set among Q and for i G I is compact. 

Let us now provide a sufficient condition for the uniqueness of an optimal solution. 

Lemma 5.3 If f is convex on [x,y], and there exists to G (0,1) such that 

f(t x + (1 - to)y) = t f(x) + (1 - t )f(y), 

then 

f(tx + (1 - t)y) = tf(x) + (1 - t)f(y), for all t G [0, 1]. 

Proof. Suppose by the contradiction that there exists t\ ^ to such that 

f(hx + (1 - h)y) < hf(x) + (1 - h)f(y). 
Consider the case to < t\. Put zq = t§x + (1 — to)y, %i = tix + (1 — t\)y. Then 

zo = —zi + (1 - —)y. 
t\ t\ 

By the convexity of / and the hypothesis, one has 
f(z ) < ^f{ Zl ) + (1 - %f(y) 

<^[t 1 /(x) + (l-ti)/(y)] + (l-^)/(y) 

= t /(x) + (l-t )/(y) 
= f(z ). 

This is a contradiction. The case where to > ti can be proved in a similar way. □ 
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Lemma 5.4 Let f = max^gj fa, where fi for i G I are convex functions on [x,y]. Suppose 
that there exists to € (0, 1) such that 

f(t x + (1 - to)y) = t f(x) + (1 - t )/(y). 

Then 

f(u) = fi(u), for all u G [x, y], 
and for any i G A(z) := {i G {1, . . . , n} | /(z) = and z = io^ + (1 — to)y. 

Proof. Put z = tox + (1 — to)y. Since / is convex on [x, y] and Lemma 5.3, one has 

f(tx + (1 - t)y) = tf(x) + (1 - t)f(y), for all t G [0, 1]. 
Take i G I such that f(z) = fi(z). Then 

f(z) = fi{z) = fi(t x + (1 - to)y) < toMx) + (1 - t )fi(y) < to f{x) + (1 - t )f(y) = f(z). 
This implies, 

fi(t x + (1 - to)y) = t fi(x) + (1 - to)fi(y), 

and 

fi(x) = f(x),f i (y) = f(y). 

The former implies that 

/i(tz + (1 - = tfi(x) + (1 - for all t G [0, 1]. 

Now, for all t G [0, 1], one has 

fi(tx + (1 - t)y) = tfi(x) + (1 - t)fi(y) = tf(x) + (1 - t)f(y) = f (tx + (1 - . 

The proof is now complete. □ 
The proof of the lemma below can be found in [21, Lemma 3.1]. 

Lemma 5.5 Let S be nonempty closed convex set. Suppose that g is a nonnegative convex 
function on S. Then the function defined by 

K x ) ■= (f(^)) 2 

is strictly convex on S if and only if g is not constant on any line segment [x, y] in S, where 
x^y. 

For x G dom T„(-; Q), define 

iLj(x; Q) = x + T v (x; Q)v. 

Lemma 5.6 If $1 is a nonempty closed convex set, x, y G dom T v (-; Q) \ Q and i-t/G M.v, 
then 

U v (x;Q) = U v (y,n). 
15 



Proof. Because of the equal role of x and y, we can assume without lost of generality that 
x — y = Xv, A > 0. Suppose by contradiction that IL v (x; Cl) ^ Il v (y; CI), which is equivalent 
to 

[x + T v {x; Cl)v] -[y + T v (y; Cl)v] = [A + T v (x; Cl) - T v (y; Cl)]v + 0. 
So, A + T v (x; Cl) — T v (y; Cl) ^ 0. If A < T v (y; Cl) then by [22, Proposition 2.8], one has 

T v (x; Cl) = T v (y + Xv; Cl) = T v (y; Cl) - X. 

Thus, A > T v (y; Cl). Using H v (y; Cl) = y + T v (y; Cl)v = x — Xv + T v (y; Cl)v and H v (x; Cl) = 
x + T v (x; Cl)v, we get 

T " (I;J!) rn,fa;Si) + , n M *a). 



\-T v (y;Sl)+Tv(x;(l) ' X — T v (y;£l) +T v (x;ti)~ 

Notice that U v (x;Cl),U v (y;Cl) € Cl and Cl is convex, which implies x G Cl. This is a 
contradiction. □ 



Lemma 5.7 IfClisa nonempty closed strictly convex set, then T v {x; Cl) is not constant on 
any line segment [x, y] C dom T v {-\ Cl) \ Cl, where x ^ y. 



Proof. If x — y £ Rv, then by [22, Proposition 2.7], T v (-;Cl) is strictly convex on [x,y], so 
T„(2^p; Cl) < max{T^(3;; Cl),T v (y; Cl)}. Consider the case where x — y = Xv, A 6 1\ {0}. 
Then by Lemma 5.6 one has Tl v (x; Cl) = ILj(y; Cl), and hence x + T v (x; Cl)v = y + T v (y; Cl)v. 
Then [A + T v {x; Cl) - T v (y; Cl)} v = 0. This implies, T v (y;Cl) = X + T v (x;Cl). Therefore, 
T v (x;Cl) ^ T v (y;Cl). Thus, T v (-;Cl) is not constant on [x,y\. □ 



Theorem 5.8 Suppose that Q C dom S\ \ Ui^iCli, Q is convex and Cl{, € /, are strictly 
convex. Then the optimization problem (5.13) has at most one optimal solution. 



Proof. Consider the problem 

minimize [5i(x)] 2 = max{[T^(x; Cli)] 2 \ i € /} subject to x € Q. (5-14) 

It is easy to show that x, is an optimal solution of the problem (5.13) if and only if it is also 
an optimal solution of problem (5.14). By Lemma 5.5 and Lemma 5.7, each T Vi (-;Cli) is 
strictly convex on Q and so is Sf. Thus, the optimization problem (5.13) has at most one 
optimal solution. □ 



5.2 Subgradient-Type Algorithms 

Let us now present numerical algorithms for solving problem (5.12). For simplicity, we only 
consider the stochastic subgradient method. The following theorem [22] plays an important 
role in our study. 
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Theorem 5.9 Let x G dom T„(-;fi), where O is convex. Then 

dT (x- U) = l N & n) n {W G ^ 1 K " V) " 1} ' ^ 55 G (5 15) 

v{ ' ; | iY(x + T„(x;ft)?;,Sl) n {w G M n | (w,v) = -1} , otherwise. K ' ' 

From formula (5.15), we see that if x € 0, then G dT v {x; O). Moreover, in the case where 
x ^ f2, if it is possible to find the normal cone to ft at the projection point H Vi (xk',^li) '■= 
x + T v (x; Q)v explicitly, then we can find a subgradient of dT v (x; ft). 

Proposition 5.10 Let Q be a nonempty closed convex set. Fix x G domT„(-;ft) \ ft. 
Suppose that 

N(x; ft) = cone {w\, . . . , w m }, 
where (u>j, v) < for i = 1, . . . , m and x := x + T v (x; £l)v. Then 



(Wi,v) 



G dT v (x; ft) for i = 1, . . . , m. 



Proof. It is clear that the vector x* := — - satisfies the conditions x* G iV(x;ft) and 

(Wi,v) 

(x*,v) = —1. Therefore, x* G <9T„(x;ft) by Theorem 5.9. □ 

Remark 5.11 The proof of the previous proposition shows that if x G dom T V (-;Q) \ ft 
with io G iV(x;ft) and (w,v) < 0, then -t^x G T„(x;ft). 

Corollary 5.12 Lei ft be nonempty closed convex set. Fix x G int(dom T„) \ ft. Suppose 
that N(x; ft) = cone {w}, where w ^ and x := x + T„(x; ft)t>. T/ien (u>, u) < and 

11) 

dT v (x;Q) = {-- ,}. (5.16) 

{w, v) 

Moreover, T„(-;ft) is differentiable at x. 

Proof. Since x G int(dom T v ), it is well-known that dT v {x\ ft) ^ 0. Fix u G dT v (x; ft). By 
Theorem 5.9, 

u G N(x, ft) n {x* G X* | (v, x*} = -1} . 
It is clear that otherwise {u, v) = 7^ —1. Thus, there exists i > such that u = tw, 

and hence (tw,v) = —1. This implies (w,v) < and t = r. We have proved that 

{w,v) 

w 

u = —-. r-. Formula (5.16) has been proved. Since the subdifferential of the function T v 

(w,y) 

at x is a singleton, this function is differentiable at x. □ 

Example 5.13 Let ft := {(x,A) G R 2 \ A > \x\} and let v = (0,1). Fix x = (xi,x 2 ) £ ft- 
If xi =0, one can see that 



dT„(x;ft) 



{(a, -1) I - 1 < a < 1} if xi = 0, 
{(-1,-1)} ifx!<0, 
{(1,-1)} ifx!>0. 
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Let us write a pseudo code for problem (5.12) using the stochastic subgradient method. 
The readers can easily write the pseudo code using other subgradient-type methods. In 
the algorithm below, for simplicity, below and thereafter, we assume that V{ G int [f2i]oo for 
i G I. Then the corresponding directional minimal time functions are globally Lipschitz; 
see [22]. 



INPUT: p, K, vi, fli for i G I , and a sequence of step sizes (a k ) 
INITIALIZE: Choose a starting point X\ and compute V\ — T\{x\) 
FOR k = l,...,K 

Choose A k , \A k \=p, to be a nonempty subset of of /, 

uniformly at random 

if x k £ Oj 

Find uu G N(IL Vi (xk;Q.i);Q.i) with (u fci ,Uj) = -l for i E A k 
end if 

Set w k := — CLieA k u ki) 

Set x k+1 :=U(x k -a k w k ;Q) 
Compute Vfc+i := min{Vfe,Ti(a; fe+ i)} 
OUTPUT: Vk+i and x k such that Ti(x k ) = Vk+i 



For u G Q, define 

A{u) :={iel \ Sx(u) = T Vi (u;Qi)}. 

Let us now present a pseudo code for solving problem (5.13) based on the subgradient 
algorithm. 



INPUT: p, K, Vi, Qi for i G J, and a sequence of step sizes (a k ) 
INITIALIZE: Choose a starting point x\ and compute V\ = Si(xi) 
FOR k = l,...,K 

Choose i G A(x k ) 

if Xk 

Find Wk G N(H Vi (xk',£li);Qi) with {wk,Vi} = -1 for i G A k 
else 

set w k = 0; break (x k is an optimal solution) 
end if 

Set x k+ i := U(x k - a k w k ;Q) 
Compute Vfe+i min{Vfe,«Si(a;fc+i)} 
OUTPUT: V K +i and x k such that Si{x k ) = V K +i 

Conclusion Remarks: In this paper, we apply different subgradient-type algorithms to 
new models of set facility location. In the next version of the paper, we will update with 
more examples to compare the methods. The subgradient-type algorithms presented in the 
paper are easy to implement, and can be used to deal with a broad range of situations. In 
some particular settings, there are of course other alternatives. We will consider that in our 
future research. 
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